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Abstract. In this article the concept of saturation of an arbitrary regularization method is 
formalized based upon the original idea of saturation for spectral regularization methods introduced 
by Neubauer [6]. Necessary and sufficient conditions for a regularization method to have global 
saturation are provided. It is shown that for a method to have global saturation the total error must 
be optimal in two senses, namely as optimal order of convergence over a certain set which at the 
same time, must be optimal (in a very precise sense) with respect to the error. Finally, two converse 
results are proved and the theory is applied to find sufficient conditions which ensure the existence 
of global saturation for spectral methods with classical qualification of finite positive order and for 
methods with maximal qualification. Finally, several examples of regularization methods possessing 
global saturation are shown. 
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1. Introduction. Let X, Y be infinite dimensional Hilbert spaces and T : X — > 
Y a bounded linear operator such that 1Z(T) is not closed. It is well known that under 
these conditions, the linear operator equation 

Tx = y (1) 

is ill-posed, in the sense that T\ the Moore-Penrose generalized inverse of T, is not 
bounded [1]. The Moore-Penrose generalized inverse is strongly related to the least 
squares solutions of (1). In fact this equation has a least squares solution if and 
only if y e V(T^) = TZ(T) © Tl{T)^ . In that t = T^y is the least squares 

solution of minimum norm and the set of all least-squares solutions of (1) is given by 
x^ + Af(T). If the problem is ill-posed then does not depend continuously on the 
data y. Therefore, if instead of the exact data y, a noisy observation y 5 is available, 
with \\y — y s \\ < 5, where 5 > is small, then it is possible that T^y s does not 
even exist and if it does, it will not necessarily be a good approximation of x* . This 
instability becomes evident when trying to approximate by traditional numerical 
methods and procedures. Thus, for instance, it is possible that the application of the 
standard least squares approximating procedure on an increasing sequence of finite- 
dimensional subspaces {X n } of X whose union is dense in X, result in a sequence 
{x n } of least squares solutions that does not converge to x* (see [8]) or, even worst, 
that they diverge from x^ with speed arbitrarily large (see [9]). 
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Ill-posed problems must be first regularized if one wants to successfully attack the 
task of numerically approximating their solutions. Regularizing an ill-posed problem 
such as (1) essentially means approximating the operator by a parametric family 
of bounded operators {R a }, where a is a rcgularization parameter. If y £ T>(T^), 

then the best approximate solution of (1) can be written as = Jjj' T " + j dE\T*y 
where {E x } is the spectral family associated to the operator T*T (see [1]). This is 
mainly why many regularization methods are based on spectral theory and consist in 

|| T ||2 

defining R a = J^ 1 " + g a {\)dE x T* where {g a } is a family of functions appropriately 
chosen such that for every A e (0, ||T|n there holds lim g a (X) = ±. 

a— >0+ 

However, it is important to emphasize that no mathematical trick can make stable 
a problem that is intrinsically unstable. In any case there is always loss of informa- 
tion. All a regularization method can do is to recover the largest possible amount 
of information about the solution of the problem, maintaining stability. It is often 
said that the art of applying regularization methods consist always in maintaining an 
adequate balance between accuracy and stability. In 1994, however, Neubauer ([6]) 
showed that certain spectral regularization methods "saturate" , that is, they become 
unable to continue extracting additional information about the exact solution even 
upon increasing regularity assumptions on it. In his article, Neubauer introduced for 
the first time the idea of the concept of "saturation" of rcgularization methods. This 
idea referred to the best order of convergence that a method can achieve indepen- 
dently of the smoothness assumptions on the exact solution and on the selection of 
the parameter choice rule. Later on, in 1997, Neubauer ([7]) showed that this sat- 
uration phenomenon occurs in particular in the classical Tikhonov-Phillips method. 
Saturation is however a rather subtle and complex issue in the study of regularization 
methods for inverse ill-posed problems and the concept has always escaped rigorous 
formalization in a general context. 

In 2001, Mathe and Pereverzev ([4]) used Hilbert scales to study the efficiency of 
approximating solutions based on observations with noise (stochastic or determinis- 
tic). In this context it is possible to quantify the degree of ill-posedness and to obtain 
general conditions on projection methods so that they attain optimal order of conver- 
gence. These concepts were later extended by the same authors ([5]) who studied the 
optimal convergence problem in variable Hilbert scales. In their article they showed 
that there is a close relationship between the optimal convergence of a method and 
the "a-priori" regularity (in terms of source sets) for spectral methods possessing 
qualification of finite order. In 2009 Hcrdman ct al. ([2]) introduced an extension of 
the concept of qualification and introduced three different levels: weak, strong and 
optimal. It was shown that weak qualification extends the definition introduced by 
Mathe and Pereverzev ([5]), in the sense that the functions associated to orders of 
convergence and source sets need not be the same. 

In 2004, Mathe ([3]) proposed general definitions of the concepts of qualification 
and saturation for spectral regularization methods. However, the concept of satura- 
tion defined by Mathe is not applicable to general regularization methods and it is 
not fully compatible with the original idea of saturation proposed by Neubauer in 
[6]. In particular, for instance, the definition of saturation given in [3] does not imply 
uniqueness and therefore, neither a best global order of convergence. 

In this article a general theory of global saturation for arbitrary regularization 
methods is developed. It is shown that saturation involves two aspects: on one hand 
(just like in Neubauer's original idea) the characterization of the best global order of 
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convergence of the method, and on the other hand, the description of the source set 
on which such a best global order of convergence is achieved. Also, necessary and 
sufficient conditions are found for a regularization method to have global saturation. 
In particular, it is shown that for a method to have saturation, it is necessary that 
the total error be optimal in two senses, namely as optimal order of convergence over 
a certain set which at the same time, must satisfy a certain optimality condition with 
respect to the error. Moreover, an explicit form for the global saturation is given 
in terms of the family of regularization operators and the operator associated to the 
problem. Lastly, sufficient conditions are provided for spectral methods with qualifi- 
cation of positive finite order and for spectral methods with maximal qualification to 
have global saturation. 

The organization of the paper is as follows. In Section 2 convergence bounds for 
regularization methods are defined and an appropriate framework for their comparison 
is developed. In Section 3 the concept of global saturation is introduced, its relation 
with the total error and with convergence bounds is shown and necessary and sufficient 
conditions for the existence of global saturation are provided. In Section 4, a few 
converse results are proved which, together with the results of Section 3, are used to 
derive sufficient conditions for the existence of global saturation for certain spectral 
regularization methods. 

2. Upper Bounds of Convergence for Regularization Methods. In this 
section we define what we call upper bounds of convergence for regularization methods 
and we develop ways of comparing them on the same as well as on different sets. 
Although this section may seem a little lengthy and tedious at a first glance, it provides 
a solid mathematical background on which all subsequent formalization and definitions 
are based upon. 

In sequel and for convenience of notation, unless otherwise specified, we shall 
assume that all subsets of the Hilbert space X under consideration are not empty and 
they do not contain x = 0. Also, without loss of generality we will assume that the 
operator T is invertible (since in the context of inverse problems one always works 
with the Moore-Penrose generalized inverse of T, the lack of injectivity is not really 
a problem). Given M C I, we will denote with Tm the collection of the following 
functions: we will say that tp £ Tm if there exists a = a(tp) > such that tp is defined 
in M x (0,a), with values in (0, oo) and it satisfies the following conditions: 

1. lim tplx, 6) = for all x £ M, and 

5->o+ 

2. tp is continuous and increasing as a function of S in (0, a) for each fixed x £ M. 
Roughly speaking, the collection Tm contains all possible 5- u orders of convergence" 
on the set M. 

Definition 2.1. Let M c X and tp, tp £ Fm- 

M _ 

i) We say that "tp precedes tp on M", and we denote it tp ^ tp, if there exist a 
constant r > and p : M —t (0, oo) such that tp(x, 5) < p(x)tp(x, 5) for all x £ M and 
for every S £ (0,r). 

M ~ M ~ 

ii) We say that a tp,tp are equivalent on M", and we denote it tp w tp, if tp ^ tp 
_ M 

and tp ^ tp. 

M ~ M ~ 

Hi) We say that "tp strictly precedes tp on M" and we denote it tp -< tp if tp X tp 
and lim sup t^'*^ = for every x £ M. 

The following observations follow immediately from these definitions. 
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• Given that V'jV' > Oj m t ne condition lim sup ^, X ' S } = is equivalent to 
lim ^r^r = 0, i-c, f/>(x,S) = oMxJ)) for 5 -»■ 0+. 

M ... Af 

• The relation introduces a partial ordering in J 7 ^/ and "~" is an equivalence 
relation in J~m- 

M M A/ - M r M Af - , 

• If V> ^ (~, <) ip then V ^ (~, -<) ip for every M C M. With ^ and ^ we 
will denote the negation of the relations -< and ps, respectively. 

M - - *f 

Lemma 2.2. Let M C X and ip,ip e J 7 !/. If ip -< ip then ip -f. 4' for every 
M C M. 

- A? 

Proof. For the contrarcciprocal. Suppose there exists M C M such that ?/> ^ ?/». 

Let G M, then ip di ip, t na t i s > there exist constants < p < oo and r > such 
that sup ^f x ° ' S s ] < P < oo. Then, 

5£(0,r) 

^(aio,^) . V(a;o,<5) . . , 4>(xo,6) 
lira sup— > linnnr — > mi — - 

,5->0+ ip(x ,S) 6^0+ 1p(x ,5) se(p,r)ip(x ,5) 

( j>(x ,S) Y\ 1 ^ n 
SU P 77 x\ > - > 0. 

\«5e(0,r)nZ0,£>)/ P 
{^o} _ M _ 

Therefore, from which we deduce that ip -fi ip, since ieo S M C M. □ 

Definition 2.3. Let {R a } a e(o,a ) be a family of regularization operators for the 
problem Tx = y. We define the "total error of {R a }ae(o.a ) at x £ X for a noise 
level S " as 

£ }r \( x ^) = inl SU P \\R a y s - x\\ , 



ae(0,a ) „5 



yS£B B {Tx) 



where B 5 {Tx) = {y EY : \\Tx - y\\ < 5}. 

Note that £f*, is the error in the sense of the largest possible discrepancy that 
can be obtained for an observation within the noise level 5, with any choice of the 
regularization parameter a. 

Remark 2.4. Let a > 0, M C X and £f£\ ■ M x (0,o) -> (0,oo) be the total 
error of {R a }. Then j € Tm- In fact, for each x € M, y(x,S) is increasing 
as a function of S, and given that {R a } is a family of regularization operators, it 
follows that y(x,S) is continuous as a function of 5 for each fixed x G M and 
lim £)°£ , (x, S) = for every x € M. 

Definition 2.5. Let {R a }a£(o,a a ) be a family of regularization operators for the 
problem Tx = y, M C X and ip £ Tm- 

i) We say thatip is an "upper bound of convergence for the total error of {Ra}ae.(0,a o ) 

M 

on M" if£l°R a} r< ip- 

ii) We say that ip is a "strict upper bound of convergence for the total error of 

{R a } a e(Q. ao ) onM" if^TL} 
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Hi) We say that ip is an "optimal upper bound of convergence for the total error 

M 

of {R a }a£(o, ao ) on M" if£{R a } r< ^ and 



£}% a} (x,8) 

lim sup — — — — > for every x £ M, 
5^ + ip{x,S) 

or equivalently, if for every x £ M £^ y(x, S) =^ o(ip(x, 5)) when 5 — > + . 

We will denote with Um^rx), ^fO^zL}) and u m ' ( £ {R a } ) the set of a11 Ac- 
tions ip £ Tm that are, respectively, upper bounds, strict upper bounds and optimal 
upper bounds of convergence for the total error of {Ra} a e(o,a ) on M. In view of 
Remark 2.4, it is clear that £ U M pt {£\°^ } ) for every M C X. 

The observations below follow immediately from the previous definitions. 

• If ip £ T M , then ip £ U M (£f£ a} ) if (and only if) E^^xJ) = 0(ip(x,6)) as 
(5^0+ for every x £ M. Moreover, U M tr (fj^ } ) and U M pt (£ } ) are disjoint subsets 
of Um(£{r j), although their union is not all of Um{£^ j) (except when M consists 
of just one element). 

• KMC M, then U M (£\t a} ) C U M (£\t a} ), Kg* c U T^ £ TL}) and 

M - 

• If ip £ U M (£\t a} ), 1> G -^M and V ^ V, then V € Mm(£$ q} ). 

_ M 

• If V G U^iE^y), yj £ U M {£\% a} ) and < ip, then G 

M ~ 

• If V G ^(f'^j), V G 7 M and V ^ V», then V € Z^f (ff^ } ) . 
Definition 2.6. Lei ip,ip £ Tm- We say that "ip an d are comparable on A/" 

M _ _ M 

i/ i/iey verify ip -< ip or ip ^ ip (or both). 

Definition 2.7. Let A C J-m and V^* G A. We say that "ip* is a minimal ele- 

/ A A Af 

meni o/ \ A, ■< \" if ip* ■< ip for every ip £ A comparable with ip* on M. Equivalently, 

/ M\ M 
ip* is minimal element of I A, ^ I if for every ip £ A, the condition ip -< ip* implies 

M 

Ip* ^ Ip. 

Lemma 2.8. Let A C J-M,p',pj* £ A and ip,ip* be comparable on M. If there 

Mo ( M\ 

exists Mo C M such that ip -< ip* then ip* is not a minimal element of I A, ^ ] . 
Proof. Let A C and ^* G .4. be comparable on M . Let us suppose that 

there exists Mq C M such that ?/> -< -0*, then it follows from Lemma 2.2 that ip* ■£* ip. 

M 

Thus ip* ^ ip and since ^, ip* £ A arc comparable on M, it follows from Definition 

/ M\ 

2.7 that '0* cannot be a minimal element of I A, ^ 

Corollary 2.9. If if.'* £ £/m(£{# o }) andthere existx £ M andijj £ U{ Xo }{£ f£ a y ) 

{x } / Af\ 

suc/i £/ia£ 0o ~^ V 1 * i/ien 0* is not a minimal element of IUm(£^ j), ^ I ■ 

Proof. This corollary is an immediate consequence of the previous lemma with 
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A = U M {£\t a} ), Mo = {x } and 



ipo(x ,S), ifx = x 
ip*(x, 6), if x 7^ xq. 



Note that this function ip so defined is in Um(£^ y) and it is comparable with ip* on 

M 

M (moreover ip d ip*). □ 
Next we will show that the optimal upper bounds of convergence for the total error 
of {Ra}ae(o,a ) on M are characterized by being minimal elements of the partially 

ordered set I Um (£f£ y), d J - More precisely, we have the following result. 

Theorem 2.10. Let ip e U M (£f R \y). Then ip £ W^ pt if and only if ' ip is 

a minimal element of I Um(£Yr i)i d 

Proof. Let ip £ W^fj^) and suppose that ip is not a minimal element of 

M\ 

Um{£{r y)i d )• Then there exists ip c G i) comparable with ip on ill for 

M 

which it is not true that ip d ip c . Then, there exists xq £ M such that 

,. i>{xo,$) 

hmsup —— — =oo. (2) 

8^0+ Vc(X ,0) 

/opt/ptot 



Now, since ip £ U A J (£y R y) and xq £ M, we have that 



limsup .. > 0. (3) 

s^ Q + ip{x ,d) 

Thus 

^l}^) £{°R a} (xoJ) ip(x ,6) 
limsup £ — — = limsup x ' — = oo 

5 ^o+ ipc(xo,o) s^o+ V{xo,o) ip c (x 0l d) 

which implies that ip c ^ Uy Xo y(£y° R This contradicts the fact that ip c £ l4M{£y°R y)- 

( M> 
Therefore, ip must be a minimal element of I Um(£{r y), d 



Conversely, assume that ip £ U M (£l R a y) and ip <£ U^f {£\° R \y) . Then there exists 

{^o} 

xq £ M such that ip £ Wr*, {£{R a y ) , which implies that ^j^} -< Lemma 2.8 



then implies that ip is not a minimal clement of \^UAi(£y° R y), -< 

From the proof of Theorem 2.10 it follows immediately that ip is a minimal element 

of fz4r d^ if and only if it is minimal of (u M * (£ \t a })> d ^ for every M* C 

M. Also, as a consequence of Theorem 2.10 one has that all optimal upper bounds 
of convergence for the total error must be equivalent in the sense of Definition 2.1-m. 
More precisely we have the following 

Corollary 2.11. LetU^^f^y) and £\° R \y be as before 

i) IfiP £ U°f\£^ } ) then ip « 
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ii) Ifi>, i/> G UT{£\°R a} ) then ^»^. 
.Proof. 

A/ 

i) If ip G W^ pt (£|° t a} ) then Sfg, ^ V, from which it follows that and ip 
are comparable on M. Then, since £f£ i G WM^jjj \) an d by Theorem 2.10 ip is a 

/ A/\ M if 

minimal element of I Wm(^|^ j), d ) , we have that ip d j. Hence, ip ~ f*^ , . 

ii) This is an immediate consequence of i) and the transitivity and reflexivity of 
the equivalence relation because by i) every ip € ^^(^{r }) ^ s equivalent to 

on M. □ 
This result says that if ip is an optimal upper bound of convergence on M for the 
total error of a regularization method, then at every point of M , ip tends to zero, as 
the noise level tends to zero, exactly with the "same speed" with which the total error 
does. 

In order to introduce the concept of saturation in the next section, we will previ- 
ously need a few more definitions and tools that will allow us to compare bounds of 
convergence on different sets of X. 

Definition 2.12. Let M, M C X, ip G T M and %p G T^- 

m,m . 

i) We say that "ip on M precedes ip on M", and we denote it with ip < ip, 
if there exist a constant d > and a function k : M x M — > (0, oo) such that 
ip{x, S) < k(x, x) ip{x, 5) for every x € M , for every x G M and for every S G (0, d). 

m,m ~ 

ii) We say that "ip on M is equivalent to ip on M ", and we denote it with ip sa ip, 

M,M _ _ M,M 

if ip p< ip and ip d ip. 

Hi) We say that "ip on M strictly precedes ip on M", and we denote it with 

M,M ~ M.M _ . . 

ip -< ip, if ip d ip and limsup j ' ' = for every x G M , x G M. 

Remark 2.13. In a certain sense, when M = M, the previous definitions gener- 
alize (although they are slightly stronger than) the relations introduced in Definition 

M,M ~ m ~ 

2.1. Note for instance that if ip -t, ip then ip -< ip, although the converse, in general, 
is not true. 

M.N _ M,N _ 

It follows immediately from Definition 2.12 that if ip d ip then ip d ip for 

M,N 

every M C M and for every N C N. The same happens for the relations " sa " and 

M.N 

Next, we also need to extend the notion of "comparability" given in Definition 
2.6, to this case. 

Definition 2.14. Let M, M c X, ip G Tm and ip G T M . 

M,M _ _ M.M 

i) We say that "ip on M is comparable with ip on M " if ip d ip or ip d ip. 

M,M 

ii) We say that "ip is invariant over M " if ip ss ip. 

M,M 

Remark 2.15. It is immediate that the condition ip a ip is equivalent to 

M,M 

ip d ip . 

This last notion of "invariance" , which will play an important roll in the char- 
acterization of saturation, roughly speaking establishes that if ip is invariant over M 
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then the orders of convergence of ip as a function of 5 when 5 — > + , in any two points 
of M, are equivalent. 

The following result is related to a certain transitivity property of this invariancc 
relation. 

- M M.M 

Lemma 2.16. Let M C X, ip, ip £ Tm be such that ip rj ip and ip « ip. Then: 

~ MM 

i) ip rs ip and 

~ mm ~ 

ii) ip ip (i.e. ip is also invariant over M J. 
Proof. 

MM - M 

Let M C X, ip,tp G Tjf] x,x £ M and suppose that ip ip and ip ip. 

i) Since ip Ki ip, there exist positive constants d, fcj, and fcj such that for every 

*G(o,d), 

ip{x,5) < k x ip{x,8) and ^(x, (5) < k x ip(x, S). (4) 

On the other hand, from the invariance of ^ over M it follows that there exist positive 
constants d* y k* - such that ^(^i <5) < s^i^i f° r everv ^ G (0, d*), which together 
with (4) implies that for every 8 £ (0, min{d, d*}), 

ip(x, S) < k x ip(x, 6) < k x k* x ip{x, 6) and ip(x, S) < k* x ip(x, 5) < k* x k x ip(x, 5). 

(5) 

. MM MM ~ ~ MM 

Since x, x € M are arbitrary, it follows that ip p< tp and ip ■< ip, that is, ip at ip. 

ii) From the first inequality in (5) and from the second inequality in (4) it follows 

_ MM ~ 

immediately that ip -< ip and therefore by Remark 2.15, ip is invariant over M. □ 
The following result is analogous to Lemma 2.2 for this case of comparison of 
convergence bounds on different sets. 

M,N - 

Lemma 2.17. Let M, N C X, ip £ T M and ip £ F N . If ip -< ip then V M C M, 

_ NM 

y N a N we have that ip 75 ip. 

Proof. By the contrareciprocal. Suppose that there exist M C M and N C N 

_ N,M 

such that ip -k ip. Then there exist a constant d > and k : N X M — > (0, 00) 
such that ip(x,S) < k(x,x)ip(x,S) for every x £ N, x € M and (5 £ (0,d). Let 
xo G M and x G iV, then ip(x ,S) < k(xo, x ) ip(x 0l 5) for every 5 £ (0,d). Thus, 

SU P tul'f) - k (xo,xo) < 00. Then, 

linrsupt^ > liminft^ > inf t M 
5^0+ ip(x ,S) *->o+ ip(x ,5) se(o,d)^(x ,S) 

\*e(o,d)V'O c o,o)y fc(x ,x ) 

{x },{x } _ M,iV _ 

Hence, ip -ft ip, from which it follows that ip -ft ip, since xo G M and 
x £ N . □ 

3. Global Saturation. We will now proceed to formalize the concept of global 
saturation. 

Definition 3.1. Let Ms c X andips £ Um s (£{°r })• We say thatips is a ''global 
saturation function of {R a } over Ms" ifips satisfies the following three conditions: 
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51. For every x* G X, x* ^ 0, x G M s , limsup £i \ a s ^' s f ) > 0. 

<5— >0+ 

52. ips * s invariant over Ms- 

53. There is no upper bound of convergence for the total error of {R a } that is a 
proper extension of ips ( in the variable x ) and satisfies SI and S2, that is, there exist 
no M ^ M$ and ip G Um^{r }) suc -h that ip satisfies SI and S2 with Ms replaced 
by M and ips replaced by ip. 

We shall refer to -0s an d Ms as the saturation function and the saturation set, 
respectively. 

Remark 3.2. Note that condition SI implies that for every M C X and for every 
ip G Um(£\°r \), limsup ' S 2 > for every x* G M, x G Ms (this is an immediate 

M 

consequence of SI and the fact that j -< ip V ip G Um(£^ \))- Therefore, it 

M,M S 

cannot happen that ip -< -05 . On the other hand, if ip G Um (£/ } ) then it is not 

M S ,M 

necessarily true that ips ^ ip even if ip on M is comparable to ips on Ms, because 
in this case it can happen that liminf ^ X,S \\ = for some x G M and some xq G 

yy (5-J-0+ vs(xs,S) J 

Ms-M 

Ms (which obviously implies that ips ^ ip), and still have limsup -^jj^fpgj > 0. 

s — 

However, if ip on M is comparable with ips on Ms and there exists lim for 

M S ,M 

every x G M and for every xs G Ms, then it is in fact true that ips ^ ip. Note 
also that condition SI can be replaced by 

ibix* 5) 

limsup 7, ' >0 M tp &Ui x *x(£)t AVir' G X,x* ^0,xGM s . 
s^o+ ips{x,S) 

This conception of global saturation essentially establishes that in no point x* G 
X, x* 0, can exist an upper bound of convergence for the total error of the regular- 
ization method that is "strictly better" than the saturation function ips at any point 
of the saturation set Ms- 

Next we show that any function satisfying condition SI, in particular any satura- 
tion function, is always an optimal upper bound of convergence. 

Lemma 3.3. Let ips G Um s (£Yr 0- If ips satisfies the condition SI on Ms, then 

His y°{R a }^ 

Proof. The condition SI implies in particular that lim sup s l > for every 

x G Ms. Since also by definition ips G Um s (£{r }) it follows that ips is an optimal 
upper bound of convergence for the total error of {R a }, i.e. ips G U M P * (£ |^ j ) . □ 
An immediate consequence of this lemma is the equivalence between the satura- 
tion function and the total error on the saturation set. 

M s 

Corollary 3.4. If ips is a saturation function of {R a \ on Ms then ips ~ 

Ms, 

tYfi i . Moreover, we have the stronger equivalence ips ~ y 

Proof. The first part of the corollary is an immediate consequence of the previous 
lemma and of Corollary 2.11 i). The second part follows from the first and the fact 

M s , M s 

that ipg m ips, via Lemma 2.16 i). □ 
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Remark 3.5. A consequence of the first part of this corollary and of Lemma 2.16 

M s Ms 

ii) is that if ips * s a saturation function of {R a } on Ms, then £^ j 

that is, the total error must be invariant over Ms- We will shed more light on this 

matter in Theorem 3.8. 

Definition 3.6. Let M c X and ip £ W^^' i). We say that "M is optimal 
for ip", and we denote it with M £ 0(ip), if the following condition holds: 

{a>o},{x} {xc},{x} 

C2. For every x £ M , x c £ M c neither ip -< ip nor ip w ip. 

That a set M be optimal for ip essentially means that at any point of the com- 
plement of M, the order of convergence of ip as a function of 6, for <5 — s- + , cannot 
be better nor even equivalent to the order of convergence of ip at any point outside 
M; that is, at any point outside of M, the order of convergence of ip must be strictly 
worse than itself at any point of M . However, we will see next that this optimality 
condition imposes a very precise restriction. As we shall see later on (Theorem 3.8), 
it is precisely this property of the total error, together with its invariance on the 
set Ms, what will allow us to characterize the regularization methods which do have 
saturation. 

Condition C2 is very precise and gives no room for maneuver. In fact, let ip £ 
Ux{£{°r i ), M C X and consider the following conditions: 

M,M° 

CI. ip -< ip. 

M C ,M M",M 

CS. ip 7^ ip and ip ip. 

Then it follows that condition C2 (of optimal set) is strictly stronger than condi- 
tion C3, and strictly weaker than condition CI. In fact, if M is optimal for ip in the 

{x a },{x} 

sense of Definition 3.6, then for every x £ M, x c £ M c we have that ip -ft ip and 

{x a },{x} M",M M C ,M 

ip ip, from which it follows immediately that ip ip and ip ip, that 

is, C3 holds. However, for condition C3 to hold it is sufficient that there exist x £ M 

and x c £ M c such that ip -ft ip and ip ip, which obviously does not imply 

condition C2. On the other hand if CI holds, then it follows from Lemma 2.17 that 

{zc},M {x c };{x} 
for every x £ M, x c £ M c , there holds ip ^ ip and therefore, ip yi. ip and 

{x c },{x} 

ip fa ip for every x £ M , x c £ M c , that is, condition C2 holds. However, C2 
does not imply CI since it can happen that M be optimal for ip and that there exist 
x £ M and x c £ M c such that ip on {x} is not comparable with ip on {x c }. This 

{x},{x c } M,M C 

implies in particular that ip £ ip and therefore, ip -fc ip. 

In order to be able to characterize the regularization methods which do have 
saturation, we will previously need the following result. 

Lemma 3.7. Suppose that {R a } has saturation function on M C X and for 

{Xc},M {=Cc},{x} 

every x £ M, x c £ M c there holds £f* a} Then £ {R a } £ {R a } 

for every x £ M , x c £ M c . 

Proof. Since {R a } has saturation function on M, it follows from Remark 3.5 

{x c },{x} 

that £f£ j is invariant over M. Suppose that j ^ £^ j for every x £ M, 
x c £ M c and that there exist x £ M, x c £ M c such that 

Ctot l^cbl^} p tot ( R \ 

c {B. a } ~ c {b„}- y°) 
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Then, 



limsup *t ' > 0. (7) 



Define M = M U {x c } and 

0(ai,<5) 



ip(x,S), if x € M 
^{^a}^' ^' if x = x c , 



where ^ is a saturation function of {R a } on M. We will show next that ip is saturation 
function on M. Clearly, ip is upper bound of convergence for the total error on M, 
i.e., ip G U£ I (8 t ^ y) and since -0 is saturation on M, it follows that ip(x,S) satisfies 

condition SI for all x G M. We will now check that ip(x c , S) also satisfies SI. Since 
.x E M it follows that 

£ tot (x* S) 

limsup^— — >0 V,'a,x'/0. (8) 

If x* G M, the above inequality follows from the fact that £¥£ x is invariant over M 

{**},{£} 

and if x* G M c , it is a consequence of the fact that x 7^ f |5e }■ 
Then, for every x* G X, x* ^ we have that 

hm sup - = lim sup tot ' > 

5^0+ 1p(x c ,S) 5^0+ £{R a }( x >°) ^(x c ,S) 

by virtue of (7) and (8). Thus, ip(x, 6) satisfies SI for every x G M. 

We will now check that ip satisfies S2 on M . Since ip is saturation function of 
{R a } on M, and iP\m = "0 we have that ?/> is invariant over M. It remains to prove 

- {x c },M - {2<,},M 

that ip & ip, i.e. that £ , ps 0. But this is an immediate consequence of 

M 

(6), of Corollary 3.4 which implies that ip ps £f£ j and the fact that 7/; is invariant 
over M, 

Thus, we have shown that ip is a proper extension of ^ satisfying and S2 on 
M, which then implies that ip does not satisfy condition S3. This contradicts the fact 
that ip is saturation function of {R a } on M. Therefore, for every x G M, x c G M c 

{x a },{x} 

there must hold that £ {R a }- D 

Theorem 3.8. (Necessary and sufficient condition for the existence of satura- 
tion.) A regularization method {R a } has saturation function if and only if there exists 
M C X (M 7^ {0},M 7^ 0) such that x is invariant over M and M is optimal 
for }• In this case £^ t (x,S) = £^ y(x,S) for x G M and 6 > is saturation 
function of {R a } on M. 

Proof. Suppose that {R a } has saturation function ip on M. Then it follows from 
Remark 3.5 that £ |^ x is invariant over M. 

Let us now check that M is optimal for j. Let x G M and x c G M c . We will 

[x c },{x] 

first show that x -ft £|"£ Since -0 € Um{£^ ,) and x G M, there exist 
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positive constants d and k x such that y(x,S) < k x tp(x,S) for every 5 G (0,d). 
Then 

,. ^{'r c ,}( X c, ^{fl Q }( a:: c,<5) 

f s + p gtot r _ > limsu P i lb(x s) > o. 

where the last inequality follows from the fact that ip satisfies condition SI on M. 

Therefore V x G M, V x c G M c , ^ This condition together with 

the fact that j is invariant over M implies, by virtue of Lemma 3.7, that V x E M, 

V a; c G A'/ c , £ {R a y We have tnus shown that M is optimal for 

Conversely, suppose that there exists M C X (M 7^ {0}, M 7^ 0) such that £|"^ , 

is invariant over M and M is optimal for £f£ j and define £^(0:, 6) = }( x >^) 

for x G M and <5 > 0. We will show that Sffi is saturation function of {R a } on M. 

Clearly, Sffi G LiM(£f^\) and since by hypothesis is invariant over M, it only 

remains to be shown that £ffi satisfies conditions SI and 55. 

In order to prove SI, let x* G X, x* ^ and a; G M. If x* G M, then the 

{x*},{x} 

invariance of £l°/ over M implies that £%p ~ £m* an d therefore 

lim SU P ctot (r ^ = lim sup jtot / i\ > °- ( 9 ) 

On the other hand, if x* G M c , the previous limit is also positive due to the fact that 

£ {R a } ~£ £ M ( b y condition C2) because M is optimal for £\f a} . Then, 
satisfies condition SI. 

Finally, suppose that £%p does not satisfy condition S3, i.e. there exist M 2 M 
and G Wj^(£iji ,) such that -0 is a proper extension of satisfying conditions 
SI and Si? on M. Let x G M \ M, then the invariance of xp over M implies that 

~ {x},M ~ 

-0 ~ "0 an d since "0 coincides with on M, it follows that 

V « 4f- (10) 

Now since G ^(£|# a} ) satisfies 5 J on M, Lemma 3.3 implies that ij> G U . 

M ~ {x} 

Then, by virtue of Corollary 2.11.Z we have that £^ j « 0. In particular, j ps 

0, which, together with (10) imply that £\°^ } w that is, £|°* q } w 

But since x G M c , this equivalence contradicts the fact that M is optimal for £f£ y 
Therefore, £ffi must satisfy condition S3 and, as a consequence, it is saturation func- 
tion of {R a } on M. □ 

Remark 3.9. From the previous theorem we conclude that a saturation function 
of a regularization method is an optimal upper bound of convergence for the total error, 
invariant and without proper extensions. 

Note that a saturation function must be optimal in two senses. In fact, if "0 is 
saturation function on M, then M is optimal for and is optimal (upper bound) 
for the total error of {R a } on M. Moreover, M and ip (modulus M,M equivalence) 
are uniquely determined. In fact, if the domain M is changed, then M is no longer 



GLOBAL SATURATION OF REGULARIZATION METHODS 



13 



optimal for ip and if the function ip is changed, even at a single point of M , in such 

a way that ip is not invariant on M , then ip it is no longer an optimal upper bound. 

_ _ _ {x } 

Suppose that at a point xq G M, we redefine ip as ip(xo, 6), where ip G PFm- Ifip ~4 ip, 

{x } ~ 

then ip is no longer an upper bound for the total error of {R a } on M and if ip -< tp 
then ip is upper bound but it is not optimal. Thus for every M C M and for every 

M.M ~ 

ip G J 7 ^ , if ip and ip are comparable on M then ip w ijj must hold. 

4. Saturation for Spectral Regularization Methods. The objective of this 
section is to apply the theory previously developed to the case of spectral regulariza- 
tion methods. Further, we show that this theory is consistent with previously existing 
results about optimal convergence of spectral regularization methods. 

Let {E\}\ e iR be the spectral family associated to the linear selfadjoint operator 
T*T and {g a } a e(o,a ) a parametric family of functions g a : [0, ||T|| 2 ] — > H for a G 
(0,ao), and consider the following standing hypotheses: 

HI. For every a G (0,ao) the function g a is piecewise continuous on [0, ||T|| ]. 

H2. There exists a constant C > (independent of a) such that |Ag Q (A)| < C 
for every A G [0, ||Tj| 2 ]. 

H3. For every A G (0, ||T|| 2 ], there exists lim g a (X) = j. 

a— >0+ 

HI G a = \\g a {-)\\ 0O =0(j s ) fora^0+. 

If {Sa}a6(o,a ) sa tishcs hypotheses H1-H3, then (see [1], Theorem 4.1) the collec- 
tion of operators {R a }ae{o.a )i where 

R a = j g a (X) dE\ T* = g a (T*T)T* , (11) 

is a family of regularization operators for T* . In this case we say that {R a } a e(o,a ) 
is a family of spectral regularization operators for Tx = y. 

Next, we recall the classical definition of qualification for a family of spectral 
regularization operators. 

Definition 4.1. Let {R a }ae(o,a ) oe the family of spectral regularization opera- 
tors for Tx = y generated by the family of functions {g a }a£(o,a ), f a (X) = 1 — Ag Q (A), 
0<a<ao; 0<A< |Tj| 2 , and let us denote with T(g a ) the set 

l(9a) = {it > : 3 k > and \r a (X)\ < ka^ V A G [0,j|r|| 2 ], Vq G (0,a )}. 

The order of the classical qualification of {R a }ae(o.a ) * s defined to be (Iq = 
sup \x and we say that {R a }a£(o,a ) h- as classical qualification of order fiQ. 

Remark 4.2. Note that by virtue of H2, G T(g a ) and the order fiQ of the 
classical qualification of a regularization method is always nonnegative ( it can be equal 
to or +oo ). 

4.1. Spectral Methods with Classical Qualification of Finite Positive 
Order. We start by considering first the case of spectral methods for which < fio < 
oo. For these methods we will first show the existence of certain upper bounds of 
convergence and then we will show that they saturate. We will also characterize their 
saturation functions and saturation sets. 

Lemma 4.3. Suppose that {<?a}ae(o.a ) sa -ti s fi es the hypotheses H1-H4- If the 
family of regularization operators {R a } a e(o.a a )j with R a defined as in (11), has clas- 
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sical qualification of order /iq, < fXo < +oo ; then ip^ (x, 8) = (5 2 fo+ 1 , for x G X^ a = 
7?.((T*r) A1 °) \ {0} and 6 > 0, is upper bound of convergence for the total error of 

{R a }ae(o, ao ) on X no, that is , VVo e U Xm(. £ {R a })- 

Proof. Since {g a } satisfies hypothesis H4, we have that G a = O f^j) when 

a — > + and therefore G a = o(— ) when a — > + . From this and from the fact that 
{g a } satisfies hypothesis H1-H3 and {R a } has classical qualification of order /io, 
< /io < +00, it follows that (see [1], Corollary 4.4 and Remark 4.5 therein) there 
exists an a-priori parameter choice rule a* : H + — > (0, ao) such that the regularization 
method (R a ,a*) is of optimal order on X Mo , that is, for every x G X^ lQ there exists 
k(x) > such that for every S > 0, 

s „ . . . __2fia_ 



sup ||-Rq,»(<5)2/ — x\\ < k{x) <5 2 "o+i . 



Then 



II A II 2 ^0 

inf sup — x\\ < k(x) <5 2 ^o+ 1 , 

aG (0,ao) y s £Bs[Tx) 

that is, £|$ } (x,6) < fc(x)^ (J). Thus£|$ } ^ </Vo and therefore V Mo eWx Mo (£|£ })■ 

□ 

Theorem 4.4. (Saturation for families of spectral regularization operators with 
classical qualification of finite positive order.) 

Suppose that {g a }a>o satisfies hypotheses H1-H4 and let r a (X) = 1 — Xg a (X). 
Suppose further that: 

i) The spectrum ofT*T has X — as accumulation point. 

ii) There exist positive constants 71,72, X\,c\, with X\ < ||T|| and c\ > 1 such 

that 

a) < r a (A) < 1, a > 0, < A < Ai; 

b) r a {X) > 7i ; < A < a < X i; 

c) |r Q (A)| is monotone increasing with respect to a for X G (0, ||T|| 2 ]; 

d) 5a(cia) > ^ , < c\ol < Ai and 

e) g a {X) > g a (X), for < a < A < A < A x . 
There exist constants 7, c > smc/j £/ia£; 

TTie family of regularization operators {i? Q } Qe (o iQo ) defined by (11), where 
ao = min{Ai, — }, has classical qualification of order /iq, < [1q < +00. 
iv) 

A \ , ,,,, _ „ „ , , _ „„„2 



|^a(A)| > 7, /or every < ca < X < \\T\f . (12) 



Thentp,, (x,5) = for x G X Mo = "K((T*T)^ o )\{0} and (5 > 0, is saturation 

function of {R a } ae{0 , ao) on X^. 

Note that the hypothesis i) is trivially satisfied if T is compact. To prove this 
theorem we will need two previous lemmas. In the first one we show that under the 
hypotheses of Theorem 4.4, for all a in a right neighborhood of zero one has that 
G p (r a (T*T)), i.e. zero belongs to the resolvent set of the operator r a (T*T). More 
precisely we have the following: 
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Lemma 4.5. Suppose that {g a } a >o satisfies hypotheses H1-H4 and assume further 
that hypotheses ii.b), ii.c), Hi) and vi) of Theorem 4-4 hold. Then for every a £ 
(0,0!o) the operator r a (T*T) is invertible, where ao = min{Ai, — }. 

Proof. It suffices to show that for every a £ (0,ao) and for every x £ X, the 
function r~ 2 (\) is integrable with respect to the measure dH^^II ■ Let a £ (0,a ) 
be arbitrary but fixed. Since ao < Ai, it follows from hypothesis ii.b) that r a (X) > 
71 > for every A £ [0, a). Then 

1 1 1 xl 1 2 

d\\E),x\\ 2 < < +oo. (13) 



o (A) 11 A | - 7 2 

|| rp II 2 _|_ 2 

It remains to prove that r a (a) ^ < +oo. For that we shall consider 

two cases. 

Case I : c < 1. In this case, for every A £ [a, \\T\\ 2 ] we have that A > a > ca > 
and from (12) it follows that |r Q (A)| > 7 (f ) Mo for every A £ [a, \\T\\ 2 }. Therefore 



1 JIIP ,,2/ [ m+ a 2 ^ I|2 ^ ||(r*iy°~" 2 



d < / 7- — rzd\\Exx\r < —, , N , < +oo- 



r 2 (A) J Q (a^"7) 2 (a^) 5 

Case II : c > 1. In this case, since ca < ||T|| 2 we write 



L 



ml + ^ dmxf = £"_L- dmxf + J<y_L- dmif . (14) 



Like in the previous case, by virtue of (12), the second integral on the RHS of 
(14) is bounded above by ( a Mo 7 )^ < +00. For the first integral on the RHS of 
(14), by virtue of hypothesis ii.c) we have that 

r*(A) > r* /e (A), V A £ [a, ca] (15) 

because — < a. On the other hand, again by using (12), and given that < c(— ) < A 
we have that 



Wc) ^ (A) ^- (16) 

From (15) and (16) we conclude that r 2 (A) > 7 2 (^) 2m ° for every A £ [a, ca]. Thus, 
for the first integral on the RHS of (14) we have the estimate 

pea 1 pea 2fi 2fj, 

L rim dtExxf - L ^f x dmxf - a*? KT " Tr " xl( < °°' 

Hence r a (T*T) is an invertible operator for every a £ (0, ao)- □ 

Lemma 4.6. Suppose that {g a }a>a satisfies the hypotheses H1-H4 and sup- 
pose further that hypotheses ii.b), ii.c), Hi) and iv) of Theorem 4-4 hold. Let 
tp : [0, ||T|| ] — > IR + be a continuous, strictly increasing function satisfying ip(0) = 0. 
If for some x* £ X, x* ^ we have that y(x*,S) = o(ip(6)) for 5 -> + , then 
there exists an a-priori parameter choice rule a(S) such that 

sup \\R a (6)y S -x*\\ = o(f(S)) for5^0 + . 

y^eB s (Tx') 
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The same remains true if we replace o(ip(6)) by 0(ip(8)). 

Proof. Let (p be as in the hypotheses and suppose that there exists x* £ X, x* =/= 
such that &<* a} (x*,6) = o(tp(6)) for <5 ^ 0+. Then by dchnition of £jR a} , 

inf sup — x* || sup 1 1 -R Q! ?/ <5 — a:* 1 1 
Inn — = Inn mi — = 0. 

5^0+ (p[0) 5-tO+ Q£(0,a ) ^(<5J 

(17) 

For the sake of simplify we introduce the following notation: 



SUp -Raj/ — x * || 

f(a,6) = - eBs{Tx ] an d h(S) = inf f(a, 8). 

tp[d) a£(0,a o ) 

Then h(S) > for every 8 £ (0, oo) and (17) can be written simply as lim h(8) = 0. 

(5— >0+ 

Next, for n £ IN we define 

8 n = sup I 8 > : /i(<5) < - 
Clearly, 8 n 1 and /i(<5) = inf f(ot,S) < i for every (5 € (0,<5 n ] for every n e IN. 

a£(0,ao) 

Then, there exists a„ = a„(5 n ) £ (0, ao) such that 

f(a n ,S)<- V5e (0,8 n ], VnelN. (18) 
n 

We then define a(<5) = a n for all 5 £ (6 n +i,8 n ] for every n £ IN. Then, since <5„ | 
it follows from (18) that lim f(a(8),8) = lim f(a n ,8 n ) = 0. We could choose 

5-5-0+ ri— >+oo 

a as the parameter choice rule we are looking for. The problem is that we cannot 
guarantee the existence of the limit of a(8) for 8 — > + . However, we will see next 
that a(8) can be replaced by a function a : K + (0, ao) such that lim a(S) = 

(i.c, such that a(8) is an admissible parameter choice rule) maintaining the condition 
lim f(a(8),8) = 0. In fact, since {a n } n £jN C (0,ao) is a bounded sequence of 

5-5-0+ 

real numbers, it contains a convergent subsequence {a nk }keTN, with a nk — > a* for 
k —> +oo, and some a* £ [0, ao]- We define a(S) = a nk for all 8 £ (8 nk+1 , 8 nk ], for 
every k £ IN. Then, 

lim a(8) = lim a n . = a*. (19) 

5—>0+ fc-s-+oo 

Since {a„ fc } fce iN and {<5 nfc }fc S iN are subsequences of {a„}„ e]N and {£„}„eiN, 
lim f(a(8),8) = lim f(a nk , S nk ) = 0. Then, by definition of /, 

5— >0+ k— >+oo 



SUP 11-Rqfflt/' 



s 



X 



Inn -r- = 0, 

5^0+ (/3(d) 



that is, 



sup \\R&(s)y -x*\\= o(<p(8)), as i->0 + . (20) 

y s eB s (Tx*) 
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It remains to be shown that a* = 0. If a* > 0, then it follows from (19) that there 
exists 5 > such that a(S) > %- for all 8 £ (0, So). Hypothesis ii.e) of Theorem 4.4 

implies then that for every 8 £ (0,<5o), |f"5(<5)M| > r a » (A) for all A £ (0,||T|| 2 ]. It 
follows that for every 8 £ (0, i5o), 



r&(8) (T*T)x* 



Then, for all 8 £ (0,<5 ), 



> 



rl {s) (\) d\\Eyx*\\ 2 



r%*_(\) d\\E\x*\ 



r^{T*T)x* 



sup 



y^B s {Tx") 



\Ra { s } y S ~ > \\R &is) Tx* -x*\\ = - g a{S) (T*T)T*T), 



\r a(S )(T*T)x*\\ > r^{T*T) 



Taking limit for 8 — > 0+ and using (20) we conclude that r^(T*T)x* = 0. But 

since ^- < ag, it follows from Lemma 4.5 that r a » (T*T) is invertible and therefore 
x* = 0, which is a contradiction since x* was not zero to start with. Hence, a* must 
be equal to zero, as wanted. 

We proceed now to prove the second part of the Lemma. Suppose that there 
exists x* £ X, x* ^ such that £ } (x* , S) = 0(tp(S)) as 5 -> 0+. Then there 
exist positive constants k and d such that inf f(a,8) < k for every 8 £ (0,d), 

q£ (0,ao) 

where f(a,8) is as previously defined. Let {<5 n } raS ]N C (0, d) be such that S n I and 
Q!n = a„(<5„) £ (0, cto) such that 

/(a„,5) < k + 5 n , V8 £ (0,d), Vn £ IN. 

We define (just like we did it previously for the "o" case) a(S) = a n for all 8 £ 
(8 n +i,S n ] for every n £ IN. Since 8 n I it follows that f(a(S),S) < k + 8\ for every 
5 € (0, d) and therefore 



sup 



|#a(,s)2/ -x* || = 0(^(5)) as5^0 H 



(21) 



y 5 eB s (Tx') 



Exactly in the same way as we proceeded before in the first part of the proof, by 
defining the function a(S) (from a convergent subsequence of {a ra }nG]N), equation (21) 
is proved with a(8) in place of a(5). Finally, and also by proceeding in an analogous 
way, it is shown that a(S) converges to zero as 8 — > + , i.e. that a(8) is an admissible 
parameter choice rule. Since the steps are essentially the same we do not give details 
here. □ 

We are now ready to prove Theorem 4.4. 

Proof of Theorem 4-4- We will show that tp IJ , (x,S) = S 2 ^o+ 1 for x £ X^ and 
8 > 0, is saturation function of {R a } a e{o,a ) on X^ a . 

First we note that by virtue of Lemma 4.3, -0^ o Mx m })■ Next we will show 
that f/Vo satisfies condition SI of saturation on X^ (sec Definition 3.1). Suppose that 
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it is not true, i.e. suppose that there exist x* € X, x* ^= and x € X„ such that 
lim sup {Ra} , — jt— = 0. Then £)°£ , (x* , 6) = o I (5 2 "o+ 1 ) as (5 — s- + and from Lemma 

4.6 it follows that there exists an a-priori admissible parameter choice rule a(6) such 
that 

sup \\R a (S)y S - = o(5^+ T ) for 5^0 + . 

y s eB s (Tx*) 

Now note that hypothesis H4 implies that there exists a finite positive constant 
P such that n/A|<7q((A)| < -^=, for every a £ (0, cto) and for every A G [0, ||T|| 2 ]- Since 
{g a } satisfies the hypotheses H1-H4 and i)-iv) hold, it follows from Theorem 3.1 of 
[6] that x* = 0, which contradicts the fact that x* was different from zero. Hence, 
ippo satisfies condition SI on X^ . Since ip^ does not depend on x, we further have 
that "0 Mo is (trivially) invariant over X^, i.e., it satisfies condition S2. 

It only remains to prove that ip^ satisfies condition S3, that is, that the set X^ 
is optimal for ip^ a . Suppose that is not the case. Then there must exist M 3 X^ 
and xjj e Um{£^ ,) such that tp \x„ g = V^o an d ^ satisfies SI and 5,3 on M. Let 
x* G M \ X M0 , x* 7^ 0. Since -0 € Z4f(£|"g ,) we have that 

(22) 

Also, since "0 is invariant over M , we have that ip ^ "0, and since tp coincides 
with -0 Mo on Xju,, , it follows that ip ^ -0 Mo . This, together with (22) implies that 

{ A "° V M o and therefore £^ a} (x*,5) = O (5W^^ as 6 -> 0+. Lemma 4.6 
then implies that there exists an a-priori admissible parameter choice rule a ((5) such 
that 



sup 



R a (S)y S ~x*\\ =o(s^^) as S^0 + . 



y s GB 5 (Tx*) 

Since /i < +00 it follows that x* G H((T*Ty°) (see [6], Corollary 2.6) and since 
x* 0, we have that x* e X^ Q which contradicts that x* € M \ X^ a . Thus, tp^ 
satisfies condition S3 and tp^ is saturation function of {R a } on X^, as we wanted 
to prove. 

4.2. Spectral Methods with Maximal Qualification. The concept of classi- 
cal qualification is a special case of a more general definition of qualification introduced 
by Mathe and Pereverzev ([5], [3]). 

Definition 4.7. Let {R a }ae(o.a a ) be a family of spectral regularization operators 
for Tx = y generated by the family of functions {ga} a e(Q,a ) an d let r Q (A) = 1 — 
Xg a (X). A function p : (0, ||T|| 2 ] — > Hl + is said to be qualification of {R a } a e{o,a ) if P 
is increasing and there exists a constant 7 > such that 

sup |?"a(A)| p(X) < 7 p(a) for every a € (0, ao). 

Ae(0,||T|| 2 ] 

//, moreover, for every X £ (0, ||T|| 2 ] there exists a constant c = c(A) > such that 

ml — > c 
ae(0,a o ) p{a) 
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then p is said to be maximal qualification of {R a }a£(o,a ) ■ 

Note then that the classical qualification of order p corresponds to the case in 
which the functions p are restricted to monomials p(t) = t p for < p < +00. 

These two definitions of qualification arc closely related. For instance, if a spectral 
regularization method {R a } possesses classical qualification of order po < 00, then 
any increasing function p : (0, ||T|| 2 ] — > H + satisfying a^ < k p(a) for some constant 
k > 0, for a in a neighborhood of a = 0, is also qualification of {R a }- Also, if a Mo 
and /5(a) are two maximal qualifications then they are necessarily equivalent in the 
sense that there exist constants k, k > such that k a Mo < p(a) < k a Mo for every 
a G (0, ao). On the other hand, if a spectral regularization method {R a } has classical 
qualification of infinite order, then it does not necessarily have maximal qualification. 

Next, we will show that under certain general hypotheses, it is also possible to 
characterize the saturation of spectral regularization methods possessing maximal 
qualification. For that we will previously need the following definition. 

Definition 4.8. Let p : (0, a] — > (0, +00) be a continuous non- decreasing function 
such that lim pit) = and (3 G H, (3 > 0. We say that p is of local upper type f3 

if there exists a positive constant d such that p{t) < d(-)@p(st) for every s G (0, 1], 
t G (0,a]. 

A function of finite upper type is also said to satisfy a condition. 

THEOREM 4.9. (Saturation for families of spectral regularization operators with 
maximal qualification.) 

Let T be a compact linear operator. Suppose that {g a }ae(o,a ) satisfies hypotheses 
H1-H4 and let {R a }ae{o.a ) oe as defined by (11). Suppose further that the following 
hypotheses are satisfied: 

Ml: There exist {X n }^ =1 C a p (TT*) and c > 1 such that X n J, and < c 

for every n G IN. 

M2: There exist positive constants Ai < ||r|| 2 , 71,72 and c\ > 1 such that 

a) < r a (A) < 1, a > 0, < A < A x ; 

b) r a (A) > 71, 0< A < a < Ai; 

c) |r Q (A)| is monotone increasing as a function of a for each A G (0, ||T|| 2 ]; 

d) g a (cia) > < c\a < Ai and 

e) g a (X) > g a {\)> for < a < A < A < Ai. 

M3: There exists p : (0, ||T|| ] — > (0, +00), strictly increasing and of local upper 
type ft, for some /3 > 0. such that p is maximal qualification o/{i? Q } ae ( 0iao ) an< ^ there 
exist positive constants a and k such that 

PW K(A)| ^ ^ A ^ Q<ka < x < M T ||2_ 

p{a) 

M4: For every a G (0,cto) the function A — > |r Q (A)| , A G (0, ||T|| ] is convex. 

Let Q(t) = Vtp(t) for t G (0, ||T|| 2 ]. Then ip(x,S) = (p o 6- 1 )((5) for x G X p = 
lZ(p(T*T)) \ {0} and 5 G (0, 0(ao)), is saturation function of {Ra} a e(o.a ) on X p . 

In order to prove this theorem we will previously need two converse results that 
we establish in the following two Lemmas. 

Lemma 4.10. Let {-R a } Q £(o,Q ) be a family of spectral regularization operators for 
Tx = y and p : (0, ||T|| ] -> 1R+ a strictly increasing continuous function satisfying 
hypothesis M3 of Theorem 4-9. If for some x G X, \\R a Tx — x\\ = 0(p(a)) for 
a 0+ 7 then x G K{p(T*T)). 
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Proof. From hypothesis M3 it follows that 

1 1 T j | ^ ~\~ 1 1 T 1 1 ^ ~\~ 

\\R a Tx-xf = r 2 Q (X)d\\E x x\\ 2 >a 2 p 2 (a) [ p~ 2 (\) d\\E\x\\ 2 . (23) 

Since ||i? Q Tx — x|| = 0(p(a)) for a — > + , it then follows that there are constants 
C > and a*, < a* < cto such that 



T ll 2 + II /? Tt - --rii 2 r 2 

p~ 2 (X)d\\E x x\\ 2 < 11 ° 2 2/ ,J P < ^ for every a e (0, a*). 

k a 



a 2 p 2 (a) a 2 



Taking limit for a —> + we obtain that jJ + p 2 (A) ci ||.Ea2;|| 2 < +oo, from which 
it follows that w = + p~ 1 (A) dE x x e X. Then, 



p(T*T) W = /" " + p(X)p- 1 (X)dE x x 
Jo 



and therefore x g K{p(T*T)). □ 

Lemma 4.11. Under the same hypotheses of Theorem 4-9, if for some x £ X we 
have that 

sup inf ||i? Q y' 5 - x|| = OO^O" 1 (<5))) w/ien J -> 0+, (24) 
y^B s (Tx) Q e(°.«o) 

tfien a; g TZ(p(T*T)). 

Proof. Without loss of generality we assume that «o < m i n { t^" > it } an d that 
x 7^ (if x = the result is trivial). 

Let A € a p (TT*) be such that < c\ X < Ai (the compactness of T guarantees 
the existence of such A), and define 

- - - A 1 / 2 

S = 5(X) = \\R x Tx-x\\. 

72 



Then, clearly the equation 



\R a Tx~x\\ 2 = (25) 



in the unknown a, has a — X as a solution. Moreover, from the hypothesis M2 c) 
and given that x ^ 0, it follows that a = A is the unique solution of (25). Note also 
that 0+ if (and only if) A -> 0+. 
Now, for <5 > define 

y" 5 = Tx- 5G- X z, V<S>0, (26) 
where = F Ci x — F x and {F x } is the spectral family associated to TT* and 

WG^TxW^Tx, -iiG x Tx^Q, 
arbitrary with ||G^z|| = 1, in other case. 

Note that since A g a p (TT*) and c\ > 1 it follows that G x is not the null operator and 
therefore the definition makes sense. Note also that \\y s — Tx\\ = S. which implies 
that y 5 g B s (Tx). 



GLOBAL SATURATION OF REGULARIZATION METHODS 



21 



Now, from (11), (26) and from the fact that g a (T*T)T* = T*g a (TT*) it follows 
that for every a € (0, «o) an d 6 > 0, 

(R a Tx-x ,R a (y s -Tx)) = (g a (T*T)T*Tx — x, —g a (T*T)T* 8G x z) 

= 8 (g a (T*T)T*Tx - x, -T* g a (TT*)G x z) 
= 8 (Tg a (T*T)T*Tx ~ Tx, ~g a (TT*)G- x z) 
= 8 ((TT*g a (TT*) - I)Tx, -g a (TT*)G x z) 
= 8 (-r a (TT*)Tx, -g a (TT*)G x z) 

\\T\\ 2 + 

r a (X)g a (X)d{F x Tx,G x z). (27) 



Now since CiA < Ax, it follows from hypothesis M2 a) that both g a (X) and r a (X) 
are nonncgative for all A 6 [0, CiA]. On the other hand, from the definitions of G x 
and z it follows immediately that the function h(X) = (F x Tx,G x z) for A G [0,ciA] is 
real and non-decreasing and therefore 

r a (X)g a (X)d(F x Tx,G x z) > 0. (28) 

On the other hand, since h(X) = (Tx, F x G x z) and F X G X = G x for every A > CiA, it 
follows that h(X) is constant for every A > CiA and therefore 

T|| 2 + 

r a (X)g a (A) d (F x Tx, G x z) = 0. (29) 

/ciA+ 

From (28) and (29) we have that 

||T|[ 2 + 



r a (X)g a (X)d{F x Tx,G x z) > 0, 

which, by virtue of (27), implies that 

(R a Tx-x,R a (y s -Tx)) > 0. (30) 

By using once again (11) and (26) together with (30) it then follows that for every 
a € (0, ao), for every A <G a p (TT*) such that CiA < Ai and for every 8 > 0, 

\\R a y S - x\\ 2 = \\R a Tx - x\\ 2 + \\R a {y S - Tx)\\ 2 + 2 (R a Tx - x, R a {y s - Tx)) 

= \\R a Tx -x\\ 2 + 8 2 \\g a (T*T)T*G x z\\ 2 + 2 (Ra Tx ~x,R a {y s - Tx)) 

> \\R a Tx - xf + S 2 \\g a (T*T)T*G x z\\ 2 

f\\T\\ 2 + 

= \\R a Tx-x\\ 2 + S 2 / Xg 2 a (X)d\\F x G x z\\ 2 
Jo 

> \\R a Tx - x\\ 2 + S 2 1 Xg 2 a (X)d\\F x G x z\\ 2 . (31) 
We now consider two different possible cases. 

Case I : a < X. Since ciA < Ai and ci > 1, it follows from hypothesis M2 e) that 
9a (A) > g a {ciX) > g a {Xi) for every A e [A,ci A]. (32) 
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On the other hand, from hypothesis M2 a) it follows that r Q (Ai) < 1, which implies 
that Ai g a {X\) > and therefore, g a {Xi) > 0. It then follows from (32) that g 2 (A) > 
5q( c i A) f° r every A G [A, c\ A]. Then, 

A Xg 2 a (X) d \\F x G x z\\ 2 > Xgl{d A) J* * d \\F x G x z\\ 2 

= \ glial), (33) 

where the last equality follows from the fact that J^ 1 X d\\F x G x z\\ 2 = 1, which is a 

consequence of the fact that j^ 1 X d \\F x G x z\\ 2 = \\F Ci x G x z\\ 2 — ||F^G^z|| 2 , from the 
definition of G x , from the fact that F x F fl = F min ^ x ^ for every A, fi G 1R and the fact 
that \\G x z\\ = 1. 

At the same time, the hypotheses M2 a) and M2 c) imply that <? a (A) is mono- 
tone decreasing as a function of a for each A G [0, Ai]. Since a < A and c\ A < Ai, we 
then have that 

g a {c 1 X)>g x (c 1 X), (34) 
and from hypothesis M2 d) we also have that 

5a(ciA)>72/A>0. (35) 
From (34) and (35) we conclude that 

^(ciA)>( 72 /A) 2 . (36) 
Substituting (36) into (33) we obtain 

lA A^ (A )rf||F A G )l z|| 2 > 72 2 /A, 



which, together with (31) imply that if a < A, then ||i? a y 5 — x\\ > (72 S) 2 /X. 

Case II : a > X. In this case, it follows from hypothesis M2 c) that r 2 (A) > 7~f(A) 
for every A G (0, ||T|| 2 ]. Then, 

r \\T\\ 2 + r \\Tf + 

\\R a Tx-x\\ 2 = r 2 a (X) d\\E x x\\ 2 > / r\{X) d \\E x x\\ 2 = \\R x Tx - x\\ 2 , 

Jo Jo 

II A 1 1 2 2 

which, together with (31) imply that LR Q y — a; > \\R x Tx — x\\ . 



Summarizing the results obtained in cases I and II, we can write: 
\\R a y s -x\\ 2 > 



-.s „,|| 2 ^ j \\R X Tx- x\\ 2 , if a > X 



( 72 <5) 2 /A, ifa<A. 

>mm{\\R x Tx-x\\ 2 ,( l2 S) 2 /X}, (37) 

which is valid for every a G (0,ao), A G <r p (TT*) such that c\X < Ai and for every 
S > 0. Then 

1 /2 

mm{\\R- x Tx~x\\, l2 S/Vl} = (mm{\\R x Tx - x\\ 2 , ( 72 <5) 2 /A}) 

< inf llR^-arll (by (37)) 

aE(0,ao) 

< sup inf ||i2„y*-a;|| (since y s G B s {Tx)) 
= 0(/9(9 -1 (<5))) for (5^0+ (by hypothesis). 
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Now, given that A = a(S) solves equation (25), from the previous inequality we 
have that 



72<VVA = 0( / o(e- i (5))) for S^Q + , 



(38) 



which implies that 



p(Q-i(6)) 



= 0[Ja(5)\ for 5 -> H 



(39) 



Since S = 9(6- 1 ( ( 5)) it follows from the definition of 6 that S = y/Q^fS) piQ' 1 {S)) . 
Then, it follows from (39) that ^/G" 1 ^) = 0(y/a(5)) for 6 -4 0+. From this and 
(38) we then deduce that: 



0{p{a(5))) for £ — > + V a{5) £ cr p (TT*) : c\ a(5) < Ai. (40) 



Now, let a £ H + such that a < max{A, : A, < — }. Then, there exist n = n(a) £ 

N such that A n +i < ex < A„ < Note here that n — > oo if (and only if) a — >• + . 
From hypothesis M2 c,) and the fact that A n £ a p (TT*) and A n < ^ it follows 

that 



\R a Tx — x\\ = 



< 



^(A)d||£7 A a;|| 



r? (A) d ||£ A a;|| 



| i?^ Tx — x | 



0(p 2 (A„)), (by virtue of (40)). 



(41) 



From hypothesis Ml we have that A„ < cA„+i and since p is strictly increasing and 
positive (by hypothesis M3) it follows that for all n big enough, more precisely for 
all n such that cA„+i < ||T|| , 



p 2 (A n ) < p 2 (cA„+i). 



(42) 



Now since c > 1 and p is of local upper type (3 for some (3 > (hypothesis iW3 ) , there 
exists a positive constant d such that 



1 



p(c\ n+ i) <dc p p[ -cA„+i I = dc /3 p(A n +i) 



(43) 



From (41), (42), (43) and from the fact that p(\ n +i) < p{a) it follows that \\R a Tx - x\\ 
0(p{a)) for a -> 0+. Therefore, Lemma 4.10 now implies that x £ K(p(T*T)). This 
concludes the proof of the Lemma. □ 

Remark 4.12. From the definition of qualification (Definition 4-7) it follows that 

r+oo 

\\R a Tx-x\\ 2 < 7 V(") / p- 2 (X)d\\E x x\\ 2 . 

Jo 
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Therefore, in Lemma 4-11, the hypothesis Ml and the assumption that p be of lo- 
cal upper type f3 for some f3 > can be substituted by the requirement that p(T*T) 
be invertible, or equivalently, that p~ 2 (X) be integrable with respect to the measure 
d\\E\x\\ for every x £ X. 

Proof of Theorem 4-9. First we note that from hypotheses M2 d) and M2 e) it 
follows easily that 

M5 : sup VX |.9q(A)| > -^= for every a £ (0,ao), 

AG(0,||T|| 2 ] v a 

where b = ^i-^fc\. As in Lemma 4.11, without loss of generality we assume that 
aa < min{-^,^r}. First we will prove that ip(x,8) = (po 6 _1 )(5) for x £ X p and 
5 £ (0, O(ao')), is an upper bound of convergence for the total error of {R a } a e(o,a ) 
in X p , that is, we will show that ip G Uxp(£¥£ })■ For every r > we define the 
source sets = {x £ X : x = p(T*T)£, ||£|| < r}. Let x £ XP, then there exists 
r > 1 such that x £ X p ' r . Since O is continuous and strictly increasing in (0,ao), 
there exists a unique a £ (0,a ) such that x £ X p ' r and 9(a) = £. Therefore, 

£\°r }( x >3) — m f SU P II -Ra y s — a:|| 

ae(0,«o) y s £Bs (Tx) 

< sup y 5 — x|| 

y s £Bs(Tx) 

< sup sup \\Ra y 5 - x\\ . (44) 

On the other hand, from hypotheses H1-H4, the fact that the function p is qualification 
of {R a }, the fact that p trivially covers p with constant equals to unity (see [5], 
Definition 2) and given that 0(a) = -, it follows by virtue of Theorem 2 in [5], that 
there exists a positive constant independent of 5 such that 

sup sup \\R & y s -x\\ < Kp ((ST 1 (- ) ) , forO < 5 < r0(j|T|| 2 ). (45) 

From (44) and (45) it follows that for every S £ (0, 0(a o )), 

£l°l } (x,S) <Kp (V 1 (1)^ < KpiQ-^S)) = Ki>(x,5), 

where the last inequality follows from the fact that r > 1 and both p and O -1 arc 
increasing functions. This proves that ip £ Uxp(£^ p- 

Next we will see that ip satisfies condition SI of saturation on X p . From hy- 
potheses H1-H4, M4 and M5 and the fact that p is maximal qualification of {R a }, 
by virtue of Theorem 2.3 and Definition 2.2 in [3], it follows that for every x* £ X, 
x* 7^ and x £ X p there exist positive constants a = a(x,x*) and d = d(x,x*) such 
that 

£t (°R \( X *> S ) 
{R : ' >a V6£(0,d). 

ip(x,d) 

Then, limsup -^fr^j% — > for every i* e X, i* / and x £ X p , that is, ib satisfies 
condition SI on X p . 
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Also, since tp does not depend on x, it is invariant over X p , i.e., ^ satisfies 
condition S2 of saturation. 

It remains to prove that ip satisfies condition S3. Suppose not. Then, there exist 
M ^ X p and $ G Um{£tr,\) such that V' \x»= 4 1 and $ satisfies SI and S2 over M. 
Let x* G M \ X p , ^ 0. Since i> G Mm^j) we have that 

31} ( 46 ) 

Since ^ is invariant over M and X p C M, it follows that ip ^ ijj and since 
V> coincides with tp on JT P , it follows that %l> ■< %l>. This together with (46) 

{x'},X p 

imply that ^ V and therefore £|£ q} (x*, (5) = O^G- 1 (<$))) for <5 -> 0+. 

Lemma 4.6 then implies that there exists an a-priori admissible parameter choice rule 
a : H + — > (0, cko) such that 

sup \\R a{S) y s -x*\\=0(p(e- 1 {5))) for <5^0+. 

Then, 

sup inf \\R a y s -x*\\=0{p(e- 1 {5))) for <5 -> 0+ 

Finally, Lemma 4.11 implies that x* G lZ(p(T*T)) and since x* 7^ 0, we have that 
T * g j^P ; w hich contradicts the fact that x* G M \ X p . Hence, ip satisfies condition 
S3 and therefore, ip is saturation function of {R a } on X p . □ 

Note that both Lemma 4.5 and Lemma 4.6 remain true if hypotheses Hi) and iv) 
of Theorem 4.4 are replaced by the requirement that there exists p : (0, ||T|| ] — > (0, 00) 
that is qualification of {R a } a e(o.a ) and satisfies the inequality in the hypothesis M3 
of Theorem 4.9. 

5. Examples. We close our investigation presenting a few examples of regular- 
ization methods possessing global saturation. For the sake of brevity we shall not 
provide much details here. 

Example 1: The family of Tikhonov-Phillips regularization operators {R a } a e(o,a ) 
is defined by (11) with <? Q (A) = It is well known that this family of regular- 

ization operators possesses classical qualification of order p a = 1. It can be easily 
checked that the family {g a } a <£(o.a ) satisfies all hypotheses of the Theorem 4.4 with 
constants C = 1, Ai = ||T|| 2 , 71 = |, c% = |, 72 = §, 7 = \ and c = 1. Therefore, 
the function ip(x,6) = 8% defined for x G X\ = 1Z(T*T) \ {0} and 6 > is global 
saturation of {R a }a£(o,a ) 011 -^l- 

Example 2: Given k G M + , for a, A > let 

for < A < a, 
for a < A < 3a, 
p^rr, for A > 3a, 
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and define g£(A) = j — a fe VA - h h a {\) for A > 0, and for A = define g k (0) = 
lim + g^(A) = It can be easily verified that for any ao > 0, {g a }ae(o.a ) s& t- 

isfies the hypotheses H1-H3 and therefore the corresponding collection of opera- 
tors {i?a}ae(o.Q ) defined by (11) is a family of spectral regularization operators for 
Tx = y. Hypothesis H2 is satisfied with C = 1 + ||T|| 3 a($. Also, it can easily be proved 

\ k M _ \n k (\)\ 

that for any A > 0, — ■ — = 0(1) for a ->• 0+ and therefore {R a } a e(o a ) 

or ' 
has classical qualification of order k. 

Now, for k > 1 and a > 0, the function g k (A) is non-increasing. Thus, hypoth- 
esis ii.e) of Theorem 4.4 holds and G„ = HflaOlloo = 9a(ty = which implies 
immediately that also hypothesis H4 is verified. From now on we shall assume k > 1 . 

Defining 

7 s , for < A < a, 

for a < A < 3a, 
(f) fe , for A > 3a, 

it follows that r£(A) = 1 - A 3 ^(A) = a fe A§ + s*(A). Clearly, r£(A) > for all A > 0. 
Now let ao = min{i, ^ } and Ai = min{l, ||T|| 2 }. It can be shown that r^(A) < 1 
for all A <G [0,Ai] and for all a <E (0,ao), i.e., hypothesis ii.a) of Theorem 4.4 is 
satisfied. 

Also, for < A < a < Ai we have that 

r k (\) = a k \i +e~^ > e" 1 , 

since ^= < 1. Thus, hypothesis ii.fo,) of Theorem 4.4 is verified with 71 = e _1 . Since 

|r^(A)| = r^(A) is monotone increasing with respect to a for all A > 0, hypothesis 
ii. c) of Theorem 4.4 is also satisfied. 
On the other hand we have that 

since a < |. Hence hypothesis ii.d^ of Theorem 4.4 holds as well with constants 

ci = 2 and 72 = - V23-i- k > for all k > 1. 

Finally, for A > 3a, 

A A 1 1. / % , 1 A A fc / /x 1. .2 /a\ fc 



from which it follows that hypothesis iv) of Theorem 4.4 is satisfied with constants 
c = 3 and 7 = 1. Hence, Theorem 4.4 allows us to conclude that the function 
ip k {x,S) = S^tt for x e X k = K{{T*T) k ) \ {0} and 5 > is global saturation of 

{Ra}a<£(0,a ) Oil X k . 

Example 3: Given e > 0, for A > and a G (0,ao) with ao < e _1 , let 



h s (X) 



a, for < A < a, 
a 1+e , for A > a, 
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and define 

1 + In < 



A In a- A- £ /i e (A) 



It can be easily checked that {ffa}a<E(o,a ) satisfies the hypotheses H1-H4- In partic- 
ular, hypothesis H2 is satisfied with C = 1. Therefore {-Ra} Q £(o,a ) with i? a as in 
(11) is a family of regularization operators for Tx = y. Also it can be shown that for 
every /i > 0, 

A M |1 — A,g^(A)| ^ for a ^ Q+ for eyery A > Q 

which implies that {^ a }a6(o,a ) nas classical qualification of order fi a = 0. Now, the 
function p{a) = — (lna) -1 is strictly increasing and of local upper type (3 for /3 = 1 
(moreover the constant d in Definition 4.8 can be taken to be d = 1) and it can also 
be proved that p is maximal qualification of {R a }ae(o,a ) and satisfies the inequality 
in the hypothesis M3 of Theorem 4.9 with constants a = 1 and k = 1. 
In this case we have that 

^(A) + A^ 

r Q (A) - 



/i E (A) - A 1+£ lna' 

Clearly, r E (A) > for all A > 0. Also, it can be shown that r E (A) < 1 for all 
A G [0, Ax] and for all a G (0, ao), where Ai = min {0.6, ||T|r}. Thus, hypothesis 
M2 a) of Theorem 4.9 is satisfied. 

Now, for < A < a < Ai, we have that 

a + A 1+£ 1 1 

r ^ Aj ~ a-A^lna - l-¥±±]na > l-a e lna' { ' 

a 

since ^— - < ^— - = a £ . Since one can easily prove that 

a a 

- a £ In a < (3c)- 1 for all a > 0, (48) 

it follows from (47) and (48) that r%(\) > (1 + ^j" 1 for < A < a < Ai, which 
implies that hypothesis M2 b) of Theorem 4.9 holds with 71 = (1 + j^,)^ 1 - Since 
|r^(A)| = r E (A) is monotone increasing with respect to a for all A > 0, hypothesis 
M2 c) of Theorem 4.9 is also satisfied. 

On the other hand, for e G (0,1) and a G (0,ao), the function <7„(A) is non- 
increasing for A G [a, Ai], which implies that hypothesis M2 e) of Theorem 4.9 is also 
satisfied. 

Assuming e G (0,1), since s £ (a) = 2 \na-2-' 1S a non -i ncrcasm g function for 
a G (0, ao) and 2a < Ai < 0.6, we have that 

F ,„ . 1 + lna 1 + In 0.3 

"9a (2a) = 771 7— > 



21na - 2- £ ~ 21n0.3 - 2~ e 

Hence hypothesis M2 d) of Theorem 4.9 is satisfied with constants c\ = 2 and 72 = 
s e (0.3). 

Finally, for every a G (0,a ) the mapping A — s- |r Q (A)| 2 , A G (0, j|T|| 2 ] is 
convex and therefore hypothesis M4 of Theorem 4.9 also holds. Hence, letting 
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8(f) = Vtp{t) = for t G (0, ||T|| 2 ], by Theorem 4.9 we conclude that i/j(x,6) = 

(po e- x )(5) for x G X" = K(p(T*T)) \ {0} = 7£ (-(ln(T*T)) _1 ) \ {0} and 



5 G (0, O(ao)) = ^0, — ^7^- J , is global saturation function of {i? Q }ag(o,Q ) on X p . 
Example 4: For A > and a G (0,ao), let <? Q (A) be defined as: 



Thus 



5a (A) 



r«(A) 



0, for < A < a, 
S -^ L -, for A > a. 



for < A < a, 
for A > a. 



It can be immediately shown that {g a }ae(o,a ) satisfies the hypotheses H1-H4 and 
therefore {R a } a e(o.a ) with R a as in (11) is a family of rcgularization operators for 
Tx = y. Also it can be easily checked that {R a }ae(o.a ) nas classical qualification of 
order = 0. Furthermore, it can be proved that the function p(a) defined by 

p(a) = ae^" 

is maximal qualification of {R a }ae(o,a ) an d ah hypotheses of Theorem 4.9 are sat- 
isfied. Hence, letting 9(t) = y/ip(t) = thih for t G (0,||T|| 2 ], by Theorem 4.9 
we conclude that ip(x,S) = (p o e^iS) for x e X p = TZ(p(T*T)) \ {0} and 5 £ 

(0, 9(ao)) = ^0, Q!q e ln °°o) J , is global saturation function of {R a }ae(o.a ) on X p . 

6. Conclusions. In this article we have developed a general theory of global 
saturation for arbitrary regularization methods for inverse ill-posed problems. This 
concept of saturation formalizes the best global order of convergence that a method 
can achieve independently of the smoothness assumptions on the exact solution and 
on the selection of the parameter choice rule. Necessary and sufficient conditions for 
a methods to have global saturation have been provided. It was shown that for a 
method to have saturation the total error must be optimal in two senses, namely 
as optimal order of convergence over a certain set which at the same time, must be 
optimal with respect to the error. We have also proved two converse results and 
applied the theory to derive sufficient conditions for the existence of global saturation 
for spectral methods with classical qualification of finite positive order and for methods 
with maximal qualification. Finally, examples of regularization methods possessing 
global saturation were shown. 
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